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1.  IHTRODUCTION 

Several  authors  have  studied  the  problem  of  combiniug 
Isdepeadent  tests « especially  noteworthy  amoog  whom  are 
fisher  (1932),  Karl  Pearson  (1933)  ‘E»S.  Pearson  (1938), 

Wallis  (1942),  A.  Birnbaum  (1954),  Liptak  (1958),  van  Zwet  and 
Oosterhoff  (1967),  Oosterhoff  (1969),  ana  Littell 
and  Polks  (1971,  1973).  The  combination  problem  has  been 
iCast  analyzed  in  various  canonical  forms  by  these 
authors,  but  for  the  purposes  of  this  essay  its  essentials 
■sy  be  described  as  follows:  Let  i-1 ,2,... ,k  be  k 
l^ependently  distributed  -statistics,  the  large  values 
of  which  are  significant  in  testing  respective  null 
l^potheses  6^  * @10  gainst  ohe-slded  alternatives 

®i1*  ®i  ^ ®i0  real-valued  parameters  6^  bf  the 

distributions  of  T^,  ia1,2,...,k.  The  problem  is  to  find 
a reasonable  combination,  i.e.  a function  of  T^,  T2,  •••, 
idxich  may  be  used  for  testing  the  . overall  hypothesis 
Hq:  ■ 6^0*  i“‘'»2,...,k  versus  the . alternative  6^  > ^io’ 

i«1,2,...,k  with  at  least  one  inequ^ity  strict.  Ilaz:y 
problems  of  combining  tests  of  composite  hypotheses,  such 
as  F-test  of  the  general  linear  hypothesis,  can  be  reduced 
to  this  form. 


NOTICE  r. 
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In  describing  the  combination  problem  it  is  often 
convenient  to  use  the  P-values  of  the  tests  as  the 
pivotal  entities  instead  of  the  statistics  I^;  a 
combination  statistic  is  then  a function  of  F^t  ^2* 

The  F-values  F^  is  of  course  the  probability, 
under  the  null  hypothesis,  of  obtaining  at  least  as 
extrome  a value  of  as  observed.  Thus  denoting  the 
null  distribution  of  T^  by^F^Q  the  F-value  is  given  by 

p.  ■ large  values  of  are  significant 

ilOl  X (1.1) 

" ^iO^^i)*  ^ small  values  of  are  significant • 

An  advantage  of  using  F^  is  thmt  it  can  be  interpreted 
by  itself,  without  a refebenee  to  the  distribution  of  T^. 
Moreover,  if  F^q  is  continuous  the  null  distribution  of 
P^  is  uniform  on  (0,1).  This  latter  property  of  the 
P-values  makes  the  null  distributions  of  combination 
statistic  manageable.  In  fact,  most  common  combination 
statistics  in  the  literature  have  simple  null  distributions, 
lotable  examples  of  such  statistics  are  (i)  T^^^amin  F^^^, 
due  to  Tippett  (1931)^(ii)  largest 

of  the  k P-values,  due  to  Wilkinson  (1951)* 

(iii)  T^'^-  -22logP,,  due  to  fisher;  (iv)  T^**^--22:iog (1-P^ , 
due  to  Pearson;  and  (v)  T^®^  • 3:a^®”^(1-p^),  due  to 
Liptak,  where  T(*)  is  the  standard  normal  d.f.  and 


are  arbitrary  weights.  Uzider  the  overall  sull 
hypothesis  and  have  beta  distributions, 

and  are  -variates  and  the  Liptak's 

fT'\  ^ 

statistic  is  normally  distributed.  Among  these 

procedures  Fisher *8  procedure,  which  re;)ect8  fi^  when 

is  large,  has  been  shown  by  Littell  and  Folks  (1973) 
to  be  most  efficient  with'  respect  to  Bahadur *s  measure 
of  A.R.E.  A forteriori,  Littell  and  Folks  (1971,  1973) 
demonstrated  that  Fisher  *a.  method  has  maximiim  Bahadizr 
A.B.E.  all  reasonable  combination  methods  based 

upon  the  P-values. 

Furthermore  Blrnbaum  (1934)  proved  that  Wilkinson's 


(1931)  and  Pearson's  (1939)  method  are  inadmissible  and 


recommended  the  use  of  Fisher's  method  for  combining 
statistics  whose  distributions  belong  to  the 


exponential  family. 

In  this  paper  we  introduce  a new  combination 
statistic,  the  logit  statistic 

and  suggest  rejecting  when  it  is  large.  We  show 
that  this  procedure  has  the  same  Bahadur  efficiency  as 
Fisher's  method  and  consequently,  because  of  a result 
of  Littell  and  Folks  (1973)*  both  procedures  are 
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The  Logit  statistic,  its  exact  null  distribution  and 
a sisple  t-approximation  to  the  null  distribution  are 
given  in  section  2.  In  section  3 the  exact  Bahadur 
slcpe  is  computed.  In  section  4 *re  answer  a question 

i 

raised  by  Oosterhoff  (1969,  p.42)  on  the  admissibility 

of  Pisher*s  method  and  discuss  some  complete  class 

results  for  both  methods.  In  section  3 we  describe  j 

a Monte  Carlo  simulation  of  the  ^power  functions  of  the  ] 

procedures  when  combining  Student  t tests. 

2.  SUE  LOGIT  PROCEDURE  ' 

Yellowing  Berkson's  (1944  ) term  for  the  log-odds 
ratio  logCF/(1-P)]  the  comhination  statistic 

k 

®L  • "i-1  logCP^/(1-pp3  (2.1) 

is  termed  the  Logit  statistic.  When  the  null 

distribution  Y^q  of  is  continuous  P^  is  uniformly 

distributed  on  (0,1).  Consequently  under  the  null 

hypothesis  «i0  - logLFj^/(1-P^)]  is  distributed  according  j 

to  the  logistic  distribution  function 

Y(s)  • tl  ♦ exp(-s)]  , --<s<-  (2.2) 
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•xia  the  Logit  statistic  is  a sum  of  i.i.d.  logistic 
variates  under  George  and  Mudholkar  (1977)  have 
shown  that  the  exact  null  distribution , of  is 
given  by 


k-1  k-l-p  p+r+1  _ , 

l-Prt(a)  - 2-  E,  (-1)*^^A.  6 , 

O'  ''  p«0  r«0  m«l  ' ' ^,p  p+r4l 


Ca"V(l-e"*)] 


(2.5) 


when  k is  even,  and  by 


k-1  k->p  ^rfk-l' 


L.  C^iy  8 , -5-1  -/m-O' 

O'  ' p»0  r-0  m«l  ' T'  ^,p  P4r4l,n  r 

Ce“*  (l4e"*)]^  (2.4) 


when  k is  odd;  where  ^ p*>  computed  from  the 
following  equations. 

- *k,0  ♦ *k,l*  ♦ ♦— 


(2.5) 


and 


(■s'sinJis)  - (-1)““^  C(2^-2)/(2n);]B2a(ns)“  , 


(2.6) 
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vhere  Bo^'s  are  Bernoulli  nunbers,  aM  6.  „*s  are 
zn  nyin 

Stirling  numbers  of  the  second  kind.  Thus  when  k ■ 2,. 

1-72(2)  ■ *(  e“*/ (l-e“®)3  ^ 4 (s-l)Ce“*/(l-e"*)]  (2.7) 

and  when  k ■ 3 

l-y^Cs)  - e^Vd+e*®)  - 2*e"*/(l4e"®)^ 

4 (z^4  n^)e“®(Ue”®)/2(l4e“*)^  . (2.8) 

^orge  and  Mudholkar  (1977)  have  illiistrated 
that  the  convolution  of  k* logistic  random  variables, 
and  hence  the  null  distribution  of  the  Legit  statistic, 
is  well  approximated  by  the  normal  distribution  with 
equal  variance,  that  this  approximation  becomes  very 
good  when  Edgeworth-corrected,  axid  that  a multiple  of 
the  student *s  t-distribution  with  the  degrees  of 
freedom  obtained  by  considering  the  kurtosis  provides  a 
simple  and  an  even  better  approximation.  Specifically, 
for  the  null  distribution  of  Logit ' statistic , it  was 
proposed  that 

w . , k(5k42) 

* ~ 3(5k44)  ^5k44  * 

I In  Table  1 the  quality  of  this  approximation  is 

I 

illustrated  numerically  for  k-3* 

■ 

I 


9 
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3.  BAHADUR  A.B.E.  OF  THE  LOGIT  STATISTIC 

The  concept  of  Bahadur  A.R.E.  is  well  discussed  in 

the  literatxire  (Bahadur  1971).  Let  T^^  be  a statistic 

for  testing  a null  hypothesis  Hq:  e e against  an 

silternative  H:6  e . Assume,  without  loss  of 

generality,  that  large  values  of  T^  are  significant, 

and  let  T ■ t be  observed.  Then  the  rate  of  convergence 
' n n 

to  sero  of  the  P-value  ^ ^n'^0^  as  n - » 

is  a measure  of  the  efficiency  of  the  test  T^. 

Specifically  suppose  that  for  i ■ 1,2  and  e there 

exist  positive  numbers  c^(6)  such  that  for  sequences -of 
tests  with  corresponding  Prvalucs 

Lim  - ^ Log  c^(e)  ais.  CPq]  (5.  ') 

— 

Then  the  Bahadur  A.R.E.  of  (T^^^)  relative  to 

n 

{!<*))  is  given  by 

»,2(e)  • c^CeVcjCe)  . (5.2) 

Sine,  a Bahadur  slop,  is  not  always  aaay  to 
compute,  Bahadur  (1971)  gave  the  following  result  to 
facilitate  its  computation. 
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Theorem  (3«1)  (Bahadur).  Suppose  that 


- h(e)  a.s.  Pq,.0  e 


(3.5) 


where  - “ < b(e)  < ^ and 


Lim  n"^logL  l-Fj^(Vn  t)]  • -f(t) 


(3.4) 


for  each  t in  some  open  interval  I,  where  Fj^(* ) is 
the  null  distribution  funotion  of  f is  continuous 
on  I and  {b(0),  6 cj.  Then 


Lim  n"^  Log  L^ 
n***® 


exists 


0(6)  - 2f(b(e)). 


(3.5) 


Theorem  3.2;  Por  i ■ 1,  k,  let  be 

“i 

sequences  of  statistics  for  respectively  testing^ 

®iO*  ®i  “ ®iO  ^il*  ®i  ^ ®iO  * ^^n^  ^ 

the  corresponding  P~values.  Assume  that  the 
are  independently  distributed  and  that  there  exists 
a positive  value  function  (6^)  defined  for 


Of  > e^Q  such  that 


) 
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Idm  nT^  log 


Ci(ei)/2  a.  8. 


(3.6) 


Also  aasuae  that 


Lim  n ./ n ■ ^ ^ , 


(3.7) 


where  iilc»n^+...  + iijj.  Then  the  exact  slope  of  the 
2«ogit  combination  procedure  for  testing  Hq:  6^  * ®i0’ 

^ i • against  H^:  0 ^ > 6 .i“l» . . . with  at  least 

one  strict  inequality,  is -given  by 


(3.8) 


Proof;  It  is  well  known  that  if  <>,^(1^)  is  a strictly 

increasing  and  continuous  fxinction  of  then 
and  Ct^)  have  the  same  exact  slopes. 

Hence  let 

t(I-)*-  j(L) 

n 

- iti  W(i  - 
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Then 


n'l  log(l-I,(i>)  - n-1  logL^^J 

■ i-1  logCl-L^^b 

Clearly  Lim  n7^1ogL^^^  - 0.(6^)  w.p.l  implies  that 
n^-  * ^ “i  ^ 

Lim  nT^  log(l  - - 0 w.p.l, 

n^- « 1 14. 

Hence  from  (3.6)  and  (3.7),  it  follows  that 


Lim  n“^  2^(1-)*.  Z \ c.(Qj)  w.p.l 

2^  CO  ^ 1“X  XX  i 

Fow  let  Pq  denote  the  d.f  of  Then 

1 - P^(t)  - 1 - fQQfnt)  - « <t<  - , 


(3.9) 


where  Pq  is  the  d.f.  of  T^'^'.  By  combining  the  expressions 
for  d.f.  of  pQ  given  by  (2.3)  and  (2.4),  it  can  easily 
be  shown  that 


l-P*(Vn  z)  - te“*^V(l-e”^*)3hj^(nz)  if  k is  even, 


- Ce““V(Ue"“*)]h«(nz)  if  k is  odd, 


(3.10) 


"?V' 


where  for  J ■ 1,2 


hj(z)-Up3^^  j(z)[  e'V  . . . 

p Az)y  1 < r < Sjare  polynomials  in  z, 
r ,0  — — ? 

and  r j.e,  l<r  are  positive  integers. 

m,J’  ■ ByO  “ ' 

' Prom  (3. 10)  we  get 

I 

- i logCl-F^C^n  z)]  - -z-  ^{log(l-e“^^).+log  h^(nz))  if  It,  is  eveu^ 

« -z-  ^{log(l+e”^^)+log  hgCaz)}  if  k is  odd^ 

Clearly  Lim  h.(nz)  « 1.  Hence 
n-*  “»  ^ 

- Lim  ^ logt  1 - z)^  ■ "Z* 

n***  “ ^ 

Using  Theorem  3.1,  we  immediately  get  the  exact  slope  of 

V-A_  it 

to  he  Littell  and  Folks  (1971)  have  shown 

that  under  the  conditions  of  Theorem  3*2,  the  exact  slope 

k 

of  Fisher’s  procedure  is  Furthermore  they  showed 

(1973)  that  among  "essentially ••  all  combination  procedures 


I 


s 


iittiiiMMSHAea 


based  on  P-values,  Fisher’s  procedvire  is  optimal 
according  to  Bahadur  A.R.E.  We  state  a slightly  more 
general  version  of  this  result,  vrtiich  holds  for  the 
Logit  and  Fisher’s  procedures. 

Theorem  3.3;  Let  be  a combination  statistic 
for  testing  Hq  against  based  -on  P-values  • 

Suppose  that  satisfies  the  following  conditions. 


^ imply  ♦ • • • * « ^xi^'^1’ * * ■ 

In  this  case  small  values  of  Tj^  are  sigiiificant. 

II.  is  non- increasing’  in  each  * i»e»» 

imply 

In  this  case  large  values  of  are  significant. 

Then  the  slopes  c(6 . ,ej^)  of  (T^^)  and 
®L^^  of  the  Logit  and  Fisher’s  procedures 

satisfy  the  inequality  c(e  . . . ,9j^)  ^ Cj^(6j^,...  ,ej^). 


REMARK;  Wieand  (1976)  has  discussed  conditions  under 
which  Bahadur's  «nd  pitman's  methods  of  comparing  tests 
coincide.  Under  the  conditions  he  stated  both  the  Logit 
Fisher's  methods  of  combining  tests  are  optimal 
with  respect  to  Pitman's  efficiency  as  well. 


TABLE  1 

THE  EXACT  AND  APPROXIMATE  *1).^. 

OF  STANDARDIZED  LOGIT  STATISTIC,  k-3 


X 

Ebcact 

Approximate 

Error 

.05 

.5209 

.5208 

0.0001 

.25 

.6033 

.6028 

0.0005 

.45 

.6809 

.6802 

0.0007 

.65 

.7506 

.7499 

0.0007 

1.00 

.6486 

.8482 

0.0004 

1.20 

.8903 

.8901 

0.0002 

1.45 

.9291 

.9291 

0.0000 

1.75 

.9598 

.9600 

-0.0002 

2.50 

.9918 

.9920 

-0.0002 

5.00 

.9975 

.9975 

0.0000 

*The  approximation  is  based  upon  Equation  2.9 


4.  ADMISSIBILITI  AND  COm>L£TE  CLASS  RESULTS 

Several  researchers  (A.  Blrnbaum  1954,  1955; 
ran  Zwet  aod  Oosterhoff  1967;  Oosterhoff  1969  and  Brown, 
Cohen  and  Strawderman  1976)  have  discussed  the  question 
of  admissibility  and  membership  in  complete  classes  of 
combination  procedures.  Birnbaum, (1955)  proved  that  if 
the  distributions  of  the  component  test  statistics  ere 
one->parameter  exponential  families,  a procedure  for 
combining  these  statistics  can  be  admissible  only  if  its 
acceptance  region  is  monotone  and  convex  in  the  (t2^,...,t^) 
space.  He  further  showed  that  this  condition  is  both 
necessary  and  sufficient  for.  admissibility  if  for  each  i, 

• is  normally  distributed  with  a known  variance. 

Oosterhoff  considered  the  more  jgeneral  problem  in  which  the 
distribution  of  the  T^,s  have  strict  monotone  likelihood 
ratio  (MLR)  properties,  then  monotone  procedures  are 
essentially  complete.  Brown  et  al  showed  that  under  the 
conditions  stated  by  Oosterhoff  monotone  procedures  are 
complete.  We  now  compare  the  Logit  and  Fisher *s  procedures 
in  the  light  of  the  above  results. 

first  we  answer  a question  raised  by  Oosterhoff  (1969, 
page  42)  and  show  that  Fisher* a procedure  is  admissible 


- 16  - 


when  the  distributions  of  the  cooponent  statistics  are 
one-parameter  exponential  families* 

Theorem  4.1:  If  for  each  i,  the  statistic  for 
testing  0^  - against  ;0i>  ^io 

densities  that  can  be  expressed  in  the  canonical  form 

f^Ctp  - h(t.)  c(0i)e®^^^  , (4.1) 

i - l,...,k  and  if  the  Tj^,e  are  independent,  then 
Pisher’s  combination  procedure  is  admissible  for  testing 
Hq:  0^-  0io*^"^‘****^  against  Hj;  6^^  > 0^^^,  i-l,...,k 
with  at  least  one  inequality  ..strict. 

The  following  result  given  by  Mudholkar  (1969) 
is  used  in  the  proof. 

Lemma  4.1:  Let  6i(Xi)  ^ positive  functions  of 
Xj^,  i-l,...,k.  If  g^(xp  is  a logconcave  function  of 
for  each  i,  then  the  set  A ■ (Xx^,.*.  ,x^): 
is  convex  for  any  positive  real  constant  c. 

Proof  of  theorem  4.1:  It  is .easily  shovm  that  if 
the  distribution  of  T^  is  given  by -equation  4.1,  then 
p..yalue  corresponding  to  observed  value  T^  ■ t^  is  given  by 


Pi(ti)  - 1 - 
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Coxisequently,  the  acceptance  region 

k . 

ky  ■ C (1»  » • • • • “2  ^®6  ^ ®p  ^ ♦ 

where  Cp  is  a constant , of  the  Fisher's  procedure « may 
be  expressed  as 

Now  for  any  vector  ouch  that  t^<tj^,  i>l,..*tk, 

it  is  clear  that  (tj^,...,t^)  ^Ap  implies  that 

(lf2^...,t'^)^Ap.  Hence  Ap  is  a monotone  acceptance  region. 

How  since  has  an  exponential - family  distribution, 
l-Fio(ti)  is  logconcave.  (Therefore  by  Lemma  4.1, 

Ap  is  convex.  The  result  of  Birnbaum  (1955)  then  implies  that 
Fisher's  procedvire  is  admissible  in  the  above  context. 

It  is  clear  that  in  the  exponential  family  case  the 
acceptance  region 

Ajj  • { (t^. . . , tj^) ! 

where  Ct  is  a constant  is  not  convex,  however, 
h 

convexity  of  on  acceptance  region  is  not  known  to  be^ 
sufficient  for  admissibility. 

Consequently  the  Logit  procedure  cannot  be  ruled 
out  as  inadmissible  in  the  context  of  exponential  family 
of  distributions.  Furthermore,  in  the  larger  context  of 
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eoBbixiing  tests  whose  eonponent  statistics  have  K.L.R.  or 
strict  H.L.B.  properties,  results  due  to  Brown  et  al  (1976) 
can  be  used  to  show  that  both  procedures  belozig  to  essentially 
complete  or  complete  classes  of  tests.  The  combination  of 
independent  Student  t test  axid  independent  F teste  are 
particular  cases  of  the  K.L.R.  families  that  are  of  practical 
importance. 

We  report  here  an  empirical  evidence  that  shows  that  in 
combining  independent  Student  t teste,  neither  of  the  Logit  or 
Fisher  *s  procedures  dominates  the  other  xiniformly. 


9.  A STUDY  OF  TEE  POWER  FUNCTIONS  BY  SIMULATION 

In  this  section  the  power  functions  of  the  Logit  and 

Fisher *s  combination  statistics  are  studied  in  the  context 

combining  Student  t tests.  Let  t^  ' i-1,2  be  two  independent 

*^i-1 

Student  t statistics  with  degrees  of  freedom  n^-1  and  n2-1 
respectively.  Let  be  used  to  test  E^q:  r^"0  versus 

HiiX  where  is  the  unknown  mean  of  a normal 

population  with  unknown  variance.  Consider  the  problem  of 
testing  the  combined  null  hypothesis  HqI  ^2*^  against  the 
alternative  : Either  ^ > 0 or  ^2  ^ ^ ^7  using  the  Logit 

statistic  T^^^  ■ log^1-pp/pJ  ♦ log^1-P2VpJ  or  the 

Fisher *s  statistic  T^^^«  -21og  P^-2  logp2f  where  P^  and  P2 
are  the  P-values  corresponding  to  ood  t^^^  respectively. 
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Although  both  and  9^^^  haro  atapla  xmll  diatributiona 
anlar  Hq,  thair  diatributiona  undar  art  eonplaz, 
eoaaaq^antly  it  ia  futila  to  attaafpt  to  obtain  thair  azact 
powar  funetiona.  ▲ raaaonabla  aatiaataa  of  tha  powara  naj 
ba  obtainad  fron  a Nonta-Carlo  azpariaant. 


5.1  the  nOSTE  CARLO  EIPERinENT 


Vor  i>1«2  n^  indapandant  atandard  normal  Tariataa 
ara  ganaratad  on  tha  IBH  360/365  eomputar  at  tha  Uziiaaraity 
of  Roohaatar  by  uaing  tha  KcGill  UniTaraity  random  number 
^paokaga  daralopad  by  a taehniqua  dua  to  Haraaglia  (1961) 
for  ganarating  atandard  normal  dariataa.  H(^^,1)  dariataa 
ara  obtainad  by  adding  to  aach  ganaratad  Tariable.  From 
thaaa  indapandant  Studant  t atatiatica  and  thair  eorraaponding 
F-raluaa  ara  obtained. 

The  powar  funetiona  of  tha  Logit  and  Fiahar*a  proeaduraa 
ara  approzimatad  from  thaaa  atatiatica  at  lawala  of  aignifance 
>■•01  and  .05  and  for  aampla  aixaa  n^*n2*5  and  n^-ng-IO. 

Tha  powar  of  aach  proeadura  ia  aatimatad  at  (0.1)  1.6 

and  ^2  * (0.1)  1.6  by  tha  proportion  of  timaa  tha 

proeadura  rajacta  Hq  in  3000  triala  at  aach  (^^,  ^2)* 

5.2  RESDI/rS 

Tabla  2 rapraaanta  aoma  aatimataa  of  tha  powar  funetiona 
of  tha  Logit  and  fiahar*a  proeaduraa.  From  tha  tabla  it  can 
ba  obaanrad  that  tha  powar  of  aach  proeadura  ia  neraaaing 
in  ^2  wEan  ia  hald  fizad  and  Tiea-raraa;  and  that  tha 
Logit  proeadura  ia  alight ly  auparior  to  Fiahar*a  proeadura 
around  tha  aquiangular  lina  whila  Fiahar«a  proeadure 

ia  auparior  alaowhara. 
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